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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 


A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 1 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )S Responsive to communication(s) filed on 27 September 2006 . 
2a)n This action is FINAL. 2b)K This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 19.21-38. 61.64.66-83. 109. 111-118 and 120-128 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) n Claim(s) is/are rejected. 

?)□ Claim(s) is/are objected to. 

8) S Claim(s) See Continuation Sheet are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1, 121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

12)^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)|g| All b)n Some * c)^ None of: 

1 Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 


Attachment(s) 

1 ) □ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Infonnation Disclosure Statement(s) (PTO/SB/08) 5) □ Notice of Informal Patent Application 

Paper No(s)/Mall Date . 6) □ Other: . 


U.S. Patent and Trademarlt Office 
PTOL-326 (Rev. 08-06) 


Office Action Summary 


Part of Paper No./Mail Date 20061 1 30 


Continuation Sheet (PTOL-326) 


Application No. 09/955,059 


Continuation of Disposition of Claims: 

Claims subject to restriction and/or election requirement are 19,21-38,61,64,66-83.109.111-118 and 120-128. 
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DETAILED ACTION 


Priority 

1. Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d), which papers 
have been placed of record in the file. 

Election/Restrictions 

2. This application contains claims directed to at least the following patentably distinct 
species: 

Species I, drawn to a video display system in which the manipulation of pointing at an 
object contained in a picture reproduced from a video deck is detected, and a commercial 
image corresponding to this object is displayed (see the Fifth Embodiment; Figs. 20-25; 
and Page 48, Line 19 - Page 57, Line 1 1 of the instant specification, for instance), 

Species II, drawn to a video display system for communicating with an E-mail server 
delivering an E-mail and commanding said E-mail server to deliver an E-mail related to 
an object recognized (see the Seventh Embodiment; Figs. 31-32; and Page 64, Line 27 - 
Page 67, Line 24 of the instant specification, for instance). 

Species III, drawn to a video display system for executing an application program 
related to a pointed object when detecting the manipulation of pointing this object (see 
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the Eighth Embodiment; Figs. 33-35; and Page 67, Line 25 - Page 71, Line 7 of the 
instant specification, for instance). 

Species IV, drawn to a video display system for executing a task related to a 
pointed object when detecting the manipulation of pointing this object (see the 
Ninth Embodiment; Figs. 36-42; and Page 71, Line 8 - Page 77, Line 9 of the 
instant specification, for instance). 

Species V, drawn to a video display system for commanding some other task executing 
device to execute a task related to a pointed object when detecting the manipulation of 
pointing this object (see an alternate variant of the Ninth Embodiment; Page 73, Line 27 - 
Page 74, Line 1 of the instant specification, for instance), and 

Species VI, drawn to a video display system for transmitting information to an add-up 
server for adding up pieces of information, and notifying said add-up server of the 
information related to a recognized object, so as to make said add-up server add up 
results of the recognition (see the Tenth Embodiment; Figs. 43-48; and Page 77, Line 10 
- Page 83, Line 15 of the instant specification, for instance). 

The species are independent or distinct because the species do not overlap in scope, i.e., 
are mutually exclusive; the species are not obvious variants; and the species each have a 
materially different design, mode of operation, function, and effect. 
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Applicants are required under 35 U.S.C. 121 to elect a single disclosed species for 
prosecution on the merits to which the claims shall be restricted if no generic claim is finally 
held to be allowable. Currently, claims 21-25, 32, 33,38, 66-70, 77, 78, 83, 111-115, 122, 123, 
and 128 appear to be generic. 

Applicants are advised that a reply to this requirement must include an identification of 
the species that is elected consonant with this requirement, and a listing of all claims readable 
thereon, including any claims subsequently added. An argument that a claim is allowable or that 
all claims are generic is considered nonresponsive unless accompanied by an election. 

Upon the allowance of a generic claim, applicants will be entitled to consideration of 
claims to additional species which depend fi-om or otherwise require all the limitations of an 
allowable generic claim as provided by 37 CFR 1 .141. If claims are added after the election, 
applicants must indicate which are readable upon the elected species. MPEP § 809.02(a). 

3. A telephone call was made to Temnit Afework (Registration Number 58,202) on 30 
November 2006 to request an oral election to the above restriction requirement, but did not result 
in an election being made. 

Applicants are advised that the reply to this requirement to be complete must include (i) 
an election of a species or invention to be examined even though the requirement be traversed 
(37 CFR 1.143) and (ii) identification of the claims encompassing the elected invention. 

The election of an invention or species may be made with or without traverse. To reserve 
a right to petition, the election must be made with traverse. If the reply does not distinctly and 
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specifically point out supposed errors in the restriction requirement, the election shall be treated 
as an election without traverse. 

Should applicants traverse on the ground that the inventions or species are not patentably 
distinct, applicants should submit evidence or identify such evidence now of record showing the 
inventions or species to be obvious variants or clearly admit on the record that this is the case. In 
either instance, if the examiner finds one of the inventions unpatentable over the prior art, the 
evidence or admission may be used in a rejection under 35 U.S.C, 103(a) of the other invention. 

4. Applicants are reminded that upon the cancellation of claims to a non-elected invention, 
the inventorship must be amended in compliance with 37 CFR 1.48(b) if one or more of the 
currently named inventors is no longer an inventor of at least one claim remaining in the 
application. Any amendment of inventorship must be accompanied by a request under 37 CFR 
1.48(b) and by the fee required under 37 CFR 1.1 7(i). 
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Conclusion 


Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jeff Piziali whose telephone number is (571) 272-7678. The 
examiner can normally be reached on Monday - Friday (6:30AM - 3PM). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bipin Shalwala can be reached on (571) 272-7681. The fax phone number for the 
organization where this appUcation or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Jeff Piziali 

30 November 2006 


